Image management system, communication terminal, communication system, image management method and recording medium

ABSTRACT

An image management system includes an image management unit configured to manage at least a piece of image information among pieces of information transmitted in a session between a plurality of communication terminals, the piece of image information being related to an image output at each of the communication terminals; and a transmission unit configured to send the piece of image information managed by the image management unit to a first communication terminal configured to output an image based on the piece of image information.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority under 35 U.S.C. § 119 toJapanese Patent Application No. 2014-249811, filed Dec. 10, 2014. Thecontents of this application are incorporated herein by reference intheir entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The disclosures herein generally relate to an image management system, acommunication terminal, a communication system, an image managementmethod and a computer readable recording medium storing a program forcausing a computer to execute a process.

2. Description of the Related Art

Communication systems that perform a telephone call, a video conferenceor the like via a communication network such as the Internet or adedicated line have become popular in recent years due to a demand forreducing travel costs and time of parties. In such a communicationsystem when communication starts between communication terminals,content data such as image data or sound data are sent/received, therebyrealizing communication between bases. Moreover, in order to perform thecommunication between bases smoothly, a method for sharing other contentbetween bases in addition to content for a telephone call has beenproposed.

For example, Japanese Patent No. 4241053 discloses a method forcontrolling a session so as to send/receive sounds to/from a terminaldevice of a communication partner, and furthermore for controlling asession so as to send/received images or handwritten data to/from theterminal device of the communication partner, thereby realizing voicesound with indicating images.

Moreover, Japanese Patent No. 4241053 discloses a terminal deviceprovided with a secondary storage device including a non-volatile memorysuch as a flash memory or a hard disk. The secondary storage devicestores data such as handwritten data that is not desired to be lost evenwhen the power is turned off.

SUMMARY OF THE INVENTION

It is a general object of at least one embodiment of the presentinvention to provide an image management system, a communicationterminal, a communication system, an image management method and acomputer-readable recording medium storing a program for causing acomputer to execute a process that substantially obviate one or moreproblems caused by the limitations and disadvantages of the related art.

In one embodiment, an image management system includes an imagemanagement unit configured to manage at least a piece of imageinformation among pieces of information transmitted in a session betweena plurality of communication terminals, the piece of image informationbeing related to an image output at each of the communication terminals;and a transmission unit configured to send the piece of imageinformation managed by the image management unit to a firstcommunication terminal configured to output an image based on the pieceof image information.

In another embodiment, a communication terminal includes a receptionunit configured to receive, from an image management system, a piece ofimage information; and an output control unit configured to control anoutput of an image based on the piece of image information received bythe reception unit. The image management system includes an imagemanagement unit configured to manage at least a piece of imageinformation among pieces of information transmitted in a session betweenthe plurality of communication terminals, the piece of image informationbeing related to an image output at each of the communication terminals;and a transmission unit configured to send the piece of imageinformation managed by the image management unit to the communicationterminal.

In yet another embodiment, a communication system includes a pluralityof communication terminals including a first communication terminal; andan image management system which includes an image management unitconfigured to manage at least a piece of image information among piecesof information transmitted in a session between the communicationterminals, the piece of image information being related to an imageoutput at each of the communication terminals; and a transmission unitconfigured to send the piece of image information managed by the imagemanagement unit to a first communication terminal configured to outputan image based on the piece of image information.

In still another embodiment, an image management method includes adding,to pieces of image information managed by an image management unit in animage management system, at least a piece of image information among thepieces of information transmitted in a session between a plurality ofcommunication terminals, the piece of image information being related toan image output at each of the communication terminals; and sending thepiece of image information managed by the image management unit to afirst communication terminal configured to output an image based on thepiece of image information.

In yet another embodiment, a non-transitory computer-readable storagemedium stores a program for causing a computer of an image managementsystem to execute a process of managing an image. The process includesadding, to pieces of image information managed by an image managementunit in the image management system, at least a piece of imageinformation among pieces of information transmitted in a session betweena plurality of communication terminals, the piece of image informationbeing related to an image output at each of the communication terminals;and sending the piece of image information managed by the imagemanagement unit to a first communication terminal configured to outputan image based on the piece of image information.

BRIEF DESCRIPTION OF THE DRAWINGS

Other objects and further features of embodiments will become apparentfrom the following detailed description when read in conjunction withthe accompanying drawings, in which:

FIG. 1 is a schematic view illustrating an example of a communicationsystem according to a present embodiment;

FIG. 2 is an external view illustrating an example of a speech terminalaccording to the present embodiment;

FIG. 3 is an external view illustrating an example of an interactivewhiteboard according to the present embodiment;

FIGS. 4A and 4B are hardware configuration diagrams illustrating anexample of the speech terminal and the interactive whiteboard accordingto the present embodiment;

FIG. 5 is a hardware configuration diagram illustrating an example of amanagement system according to the present embodiment;

FIG. 6 is functional block diagrams illustrating an example of thespeech terminal, the interactive whiteboard and the management systemaccording to the present embodiment;

FIGS. 7A to 7D are conceptual diagrams illustrating an example ofrespective management tables managed in the management system accordingto the present embodiment;

FIG. 8 is a sequence diagram illustrating an example of a process untila session between the speech terminal or the interactive whiteboard andthe management system is established according to the presentembodiment;

FIG. 9 is a sequence diagram illustrating an example of a process ofestablishing a session between the speech terminals or between theinteractive whiteboards according to the present embodiment;

FIGS. 10A to 10C are sequence diagrams illustrating an example ofprocesses of sending image information between the interactivewhiteboards according to the present embodiment;

FIG. 11 is a sequence diagram illustrating an example of a process ofreproducing an image according to the present embodiment;

FIG. 12 is a flowchart illustrating an example of a process ofcontrolling an output of a shared screen of the whiteboard according tothe present embodiment;

FIGS. 13A and 13B are views illustrating an example of a displayed imageaccording to the present embodiment;

FIG. 14 is a view illustrating another example of the displayed imageaccording to the present embodiment;

FIG. 15 is a view illustrating yet another example of the displayedimage according to the present embodiment;

FIG. 16 is a view illustrating still another example of the displayedimage according to the present embodiment; and

FIG. 17 is a view illustrating yet another example of the displayedimage according to the present embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following, embodiments of the present invention will be describedwith reference to the accompanying drawings.

General Arrangement of Embodiment

FIG. 1 is a schematic view illustrating a communication system accordingto an embodiment of the present invention. As shown in FIG. 1, thecommunication system 1 includes communication terminals such as videoconference terminals (10 a, 10 b, 10 c), interactive whiteboards (in thefollowing, denoted as “IWB”) as an example of image sharing devices (20a, 20 b, 20 c) and a management system 50 for managing the respectivecommunication terminals 10. In the following, in a case of representingan arbitrary communication terminal of the video conference terminals(10 a, 10 b, 10 c), it is denoted as a speech terminal 10. Moreover, ina case of representing an arbitrary IWB of the IWBs (20 a, 20 b, 20 c),it is denoted as an IWB 20. The management system 50 is a computerprovided with a server function.

By the communication system 1, speech communication can be performedbetween users of the speech terminals (10 a, 10 b, 10 c). The speechcommunication can be realized by sound or sound and video (image).Moreover, an image in which a character, a figure, a symbol or the likeis drawn can be shared among users of the IWBs (20 a, 20 b, 20 c).

Moreover, the speech terminal 10, the IWB 20 and the management system50 can perform communication by a communication network such as theInternet, a mobile telephone network or a LAN (Local Area Network). Ateach of locations (A, B, C), a speech terminal 10 and an IWB 20 arearranged, and a video conference can be performed between the locationsby using both the speech terminal 10 and the IWB 20. Meanwhile, in FIG.1, in order to make explanation simple, at each of the locations (A, B,C), one speech terminal 10 and one IWB 20 are shown. But, pluralterminals or plural IWBs may be arranged. Moreover, at each of thelocations (A, B, C), for example, a communication terminal other thanthe speech terminal 10 and the IWB 20, such as a projector or a digitalsignage device may be arranged for a communications connection via thecommunication network 2.

Hardware Configuration of the Embodiment

Next, a hardware configuration of the present embodiment will bedescribed. FIG. 2 is an external view of a speech terminal 10 accordingto the present embodiment. As illustrated in FIG. 2, the speech terminal10 includes a casing 1100, an arm 1200 and a camera housing 1300. Amongthese portions, a front wall 1110 of the casing 1100 has an inlet faceincluding a plurality of inlet holes, and a back wall 1120 of the casing1100 has an exhaust face 1121 on which a plurality of exhaust holes areformed. Accordingly, by driving a cooling fan included in the casing1100, air behind the speech terminal 10 can be taken in via the inletface and exhausted to the rear of the speech terminal 10 via the exhaustface 1121. A right-side wall 1130 of the casing 1100 has a sound pickuphole 1131, and a built-in microphone 114, described later, is capable ofpicking up voice, sound, noise or the like.

An operation panel 1150 is formed toward the right-side wall 1130 of thecasing 1100. The operation panel 1150 has a plurality of operationbuttons (108 a to 108 e) described later, a power switch 109 describedlater, and an alarm lamp 119 described later. The operation panel 1150also has a sound output face 1151, which is formed of a plurality ofsound output holes for allowing output sound from a built-in speaker115, described later, to pass through. In addition, an accommodationportion 1160 serving as a recess for accommodating the arm 1200 and thecamera housing 1300 is formed toward a left-side wall 1140 of the casing1100. A plurality of connection ports (1132 a to 1132 c) forelectrically connecting cables to an external device connectioninterface (I/F) 118 described later are provided on the right-side wall1130 of the casing 1100. In contrast, a connection port for electricallyconnecting a cable 120 c for a display device 120 to the external deviceconnection I/F 118 described later is provided toward the left-side wall1140 of the casing 1100.

Meanwhile, the following description uses the term “operation button108” for indicating an arbitrary one of the operation buttons (108 a to108 e), and the term “connection port 1132” for indicating an arbitraryone of the connection ports (1132 a to 1132 c).

Next, the arm 1200 is attached to the casing 1100 via a torque hinge1210 and is configured to be rotatable in the vertical direction withina range of a tilt angle θ1 of 135 degrees with respect to the casing1100. FIG. 2 indicates a state in which the tilt angle θ1 is 90 degrees.The camera housing 1300 has a built-in camera 112, which will bedescribed later, and the camera 112 can capture an image of a user, adocument, a room, or the like. In addition, the camera housing 1300 hasa torque hinge 1310. The camera housing 1300 is attached to the arm 1200via the torque hinge 1310 and is configured to be rotatable in thevertical and horizontal directions within a range of a pan angle θ2 of±180 degrees and a tilt angle θ3 of ±45 degrees with respect to the arm1200, where the state illustrated in FIG. 3 is 0 degrees.

Meanwhile, the external view illustrated in FIG. 2 is only exemplary andthe appearance is not restricted. The speech terminal 10 may be, forexample, a generic PC, a smart phone, a tablet terminal or the like. Thecamera 112 and the microphone 114 need not necessarily be built-indevices and may be external devices.

FIG. 3 is an external view of the IWB 20 according to the presentembodiment.

As illustrated in FIG. 3, the IWB 20 includes a display device 220, astand 240 and a device storage part 250. The display device 220 includesa flat panel such as a liquid crystal display (LCD) or a plasma displaypanel (PDP), and a display surface 222 for displaying an image and atouch panel 224 are arranged in front of a casing of the display device220.

In an input device 300, a signal transmission device is arranged. In acase of bringing a nib of the input device 300 into contact with thedisplay surface 222, the signal transmission device sends a writingdetection signal (contact detection signal) as a wireless signal. At atiming that the writing detection signal sent by the input device 300 isreceived on the side of the IWB 20, the display device 220 displays acharacter, a figure or the like written at a coordinate positiondetected by the touch panel 224.

Moreover, in a case of bringing another end of the input device 300 intocontact with the display surface 222, the signal transmission devicesends an erasing detection signal (contact detection signal) as awireless signal. At a timing that the erasing detection signal sent bythe input device 300 is received on the side of the IWB 20, the displaydevice 220 erases a character, a figure or the like written at acoordinate position detected by the touch panel 224 from the displaysurface.

The device storage part 250 stores, for example, various devices such asa main body of the IWB 20. Moreover, on an upper face of the devicestorage part 250 is installed a keyboard 230 with which an inputoperation is performed.

Meanwhile, the management system 50 has the same external appearance asthat of a generic server computer, and a description of the externalappearance will be omitted.

FIG. 4A is a hardware configuration diagram of a speech terminal 10according to the present embodiment. As illustrated in FIG. 4A, thespeech terminal 10 includes a central processing unit (CPU) 101 thatcontrols an overall operation of the speech terminal 10, a read-onlymemory (ROM) 102 that stores a program used for driving the CPU 101,such as an initial program loader (IPL), a random-access memory (RAM)103 used as a work area for the CPU 101, a flash memory 104 that storesvarious types of data, such as programs for various types of terminals,image data and sound data, a solid state drive (SSD) 105 that controlsreading/writing of various types of data from/to the flash memory 104under control of the CPU 101, a medium drive 107 that controlsreading/writing (storage) of data from/to a recording medium 106 such asa flash memory, the operation button 108 operated in a case of selectinga destination, the power switch 109 for turning ON/OFF the power of thespeech terminal 10, and a network interface (I/F) 111 for performingdata communication using the communication network 2.

In addition, the speech terminal 10 includes the built-in camera 112,which captures an image of a subject and obtains image data undercontrol of the CPU 101; an imaging element I/F 113 that controls drivingof the camera 112; the built-in microphone 114, which receives a soundinput; the built-in speaker 115, which outputs sound; a soundinput/output I/F 116 that processes inputting/outputting of a soundsignal between the microphone 114 and the speaker 115 under control ofthe CPU 101; a display I/F 117 that communicates image data to anexternal display device 120 under control of the CPU 101; the externaldevice connection I/F 118 for connecting various external devices; thealarm lamp 119, which indicates an abnormality of various functions ofthe speech terminal 10; and a bus line 110 such as an address bus or adata bus for electrically connecting the above-described elements asillustrated in FIG. 4A.

The display device 120 includes a liquid crystal display device (LCD),an organic electroluminescence (EL) display device, or the like, anddisplays an image of a subject, an icon for operation, or the like. Inaddition, the display device 120 is coupled to the display I/F 117 bythe cable 120 c. The cable 120 c may be an analog red green blue (RGB)(video graphic array (VGA)) signal cable, a component video cable, ahigh-definition multimedia interface (HDMI(trademark registered)) signalcable, or a digital video interactive (DVI) signal cable.

The camera 112 includes a lens and a solid-state imaging element thatconverts light into electric charges to eletronize an image (video) of asubject. As the solid-state imaging element, for example, acomplementary metal-oxide-semiconductor (CMOS) or a charge-coupleddevice (CCD) is used.

The external device connection I/F 118 is capable of connecting externaldevices such as an external camera, an external microphone and anexternal speaker, respectively, by using a Universal Serial Bus (USB)cable or the like, which is inserted into the connection port 1132 ofthe casing 1100. In the case where an external camera is connected, theexternal camera is driven in preference to the built-in camera 112 undercontrol of the CPU 101. Similarly, in the case where an externalmicrophone is connected or an external speaker is connected, theexternal microphone or the external speaker is driven in preference tothe built-in microphone 114 or the built-in speaker 115 under control ofthe CPU 101.

Meanwhile, the recording medium 106 is configured to be removable fromthe speech terminal 10. In addition, a non-volatile memory that reads orwrites data under control of the CPU 101 is not limited to the flashmemory 104, and an electrically erasable and programmable read-onlymemory (EEPROM) may be used.

Meanwhile, the display device 120 may be built-in in the main body ofthe speech terminal 10. Moreover, in each of the various types ofcommunication terminals, a hardware configuration depending on itsfunction, which is not shown in FIGS. 4A and 4B, may be arranged.Furthermore, a part of the hardware configuration shown in FIGS. 4A and4B may not be arranged.

Subsequently, by using FIG. 4B, difference between a hardwareconfigurations of the IWB 20 and of the speech terminal 10 will beexplained. FIG. 4B is the hardware configuration diagram illustratingthe IWB 30 according to the present embodiment. Differently from thespeech terminal 10, the IWB 20 according to the present embodiment doesnot include a camera 112, an imaging element I/F 113, a microphone 114,a speaker 115 and a sound input/output I/F 116.

On the other hand, the IWB 20 is provided with a touch panel 224, an I/F121 for the touch panel 224 and a signal reception device 225 forreceiving a contact detection signal sent from the input device 300 andoutputting the contact detection signal to the touch panel 224. A touchpanel driver, which is a control circuit for the touch panel 224,recognizes that an input operation is performed based on the contactdetection signal sent from the input device 300, and outputs imageinformation corresponding to the input operation by the input device300. The built-in display device 220 in the IWB 20 outputs respectiveimages superposed based on image information output by the touch paneldriver at a timing of an input operation or image information sent fromother IWB 20 via the communication network 2. Moreover, the IWB 20 isprovided with the keyboard 230. Based on an operation for the keyboard230, an operation input can be received.

FIG. 5 is a hardware configuration diagram of the management system 50according to the present embodiment. The management system 50 includes aCPU 501 that controls the overall operation of the management system 50;a ROM 502 that stores a program used for driving the CPU 501, such as anIPL; a RAM 503 used as a work area for the CPU 501; an HD 504 thatstores various types of data, such as a program for the managementsystem 50; a hard disk drive (HDD) 505 that controls reading/writing ofvarious types of data from/to the HD 504 under control of the CPU 501; amedium drive 507 that controls reading/writing (storage) of data from/toa recording medium 506 such as a flash memory; a display device 508 thatdisplays various types of information such as a cursor, a menu, awindow, characters or an image; a network I/F 509 for communicating datausing the communication network 2; a keyboard 511 including a pluralityof keys for entering characters, numerals, various instructions or thelike; a mouse 512 that performs selection and execution of variousinstructions, selection of a processing target, movement of a cursor orthe like; a compact disc read-only memory (CD-ROM) drive 514 thatcontrols reading/writing of various types of data from/to a CD-ROM 513serving as an example of a removable recording medium; and a bus line510 such as an address bus and a data bus for electrically connectingthe above-described elements as illustrated in FIG. 5.

Functional Configuration of the Embodiment

Next, the functional configuration of the embodiment will be described.FIG. 6 is a functional block diagram of the speech terminal 10, the IWB20 and the management system 50 of the communication system 1 accordingto the present embodiment. In FIG. 6, the terminal 10, the IWB 20 andthe management system 50 are connected to be capable of communicatingdata via the communication network 2.

<Functional Configuration of Communication Terminal>

The speech terminal 10 as a communication terminal includes atransmission/reception unit 11, an operation input reception unit 12, adisplay control unit 13 and a storage/readout unit 19. On the otherhand, the IWB as a communication terminal includes atransmission/reception unit 21, an operation input reception unit 22, adisplay control unit 23 and a storage/readout unit 29, in the same wayas the speech terminal 10. These elements are functions that arerealized by operating any of the elements illustrated in FIG. 4 (FIG. 4Aor FIG. 4B) in response to a command from the CPU 101 in accordance witha program loaded from the flash memory 104 onto the RAM 103. Moreover,the speech terminal 10 or the IWB 20 has a storage unit (1000, 2000)configured with the ROM 102, the RAM 103 and the flash memory 104.

(Respective Functional Configurations of Communication Terminal)

Next, using FIG. 6, respective functional configurations of the speechterminal 10 and the IWB 20 will be described in detail. Meanwhile, inthe following description of the respective functional configurations ofthe speech terminal 10 and the IWB 20, among the respective elementsillustrated in FIG. 4A or FIG. 4B, relationships with main elements forrealizing the respective functional configurations of the speechterminal 10 and the IWB 20 will also be described.

The transmission/reception units (11, 21) of the speech terminal 10 andthe IWB 20 are enabled by commands from the CPU 101 and via the networkI/F 111, and perform transmission/reception of various types of data (orinformation) to/from the speech terminal of the other side, eachapparatus, a system or the like via the communication network 2.

The operation input reception unit 12 is enabled by a command from theCPU 101, the operation button (108 a, 108 b, 108 c, 108 d, 108 e) andthe power switch 109, and receives various inputs from a user or avarious types of selections by the user.

The operation input reception unit 22 is enabled by a command from theCPU 101, the touch panel 224, the power switch 109 and the keyboard 230,and receives various inputs from the user or a various types ofselections by the user.

The display control unit (13, 23) is enabled by a command from the CPU101 and the display I/F 117, and controls transmission of image datasent from a communication terminal of the other side to the displaydevice 120. Meanwhile, in a case of the IWB 20, the image data to besent to the display device 220 may be image information sent from an IWB20 of the other side or may be image information based on an operationfor the input device 300 of the own terminal.

The storage/readout unit (19, 29) is enabled by a command from the CPU101, and stores various types of data into the storage unit (1000, 2000)and extracts various types of data from the storage unit (1000, 2000).

<Functional Configuration of Management System>

The management system 50 includes a transmission/reception unit 51, anauthentication unit 52, a management unit 53, a creation unit 54, acooperation management unit 57, a session control unit 58 and astorage/readout unit 59. These elements are functions or means that areenabled by operating any of the elements illustrated in FIG. 5 inresponse to a command from the CPU 501 in accordance with a program forthe management system 50 loaded from the HD 504 onto the RAM 503. Inaddition, the management system 50 includes a storage unit 5000configured with the HD 504. The storage unit 5000 includes anauthentication management DB 5001 made of an authentication managementtable which will be described later, a terminal management DB 5002 madeof a terminal management table, a cooperation management DB 5003 made ofa cooperation management table and an image information management DB5004 made of an image information management table.

(Terminal Authentication Management Table)

FIG. 7A is a conceptual diagram illustrating the terminal authenticationmanagement table. In the terminal authentication management table, apassword is managed in association with a communication ID foridentifying a speech terminal 10 of communication destination or an IWB20. Meanwhile, the communication ID here may be an ID stored in acommunication terminal in advance or may be an ID which a user inputs tothe communication terminal. In a case where the communication ID isinput to the communication terminal, the communication ID sent from thecommunication terminal upon the login request is managed in themanagement system 50 in association with the communication terminal ofthe login request source, and thereby the communication terminal can beidentified based on the communication ID. Meanwhile, the explanationcontinues assuming that communication IDs of the speech terminals (10 a,10 b, 10 c) are “01 a, 01 b, 01 c”, respectively, and communication IDsof the IWBs (20 a, 20 b, 20 c) are “02 a, 02 b, 02 c”, respectively.

(Terminal Management Table)

FIG. 7B is a conceptual diagram illustrating the terminal managementtable. In the terminal management table, a terminal name and anoperation state of each communication terminal are managed inassociation with the communication ID, for communication ID of each ofvarious types of communication terminals such as the speech terminal 10or the IWB 20. Meanwhile, the operation state shows “online”, which is astate where the communication terminal indicated by the communication IDis coupled to the management system 50, or “offline”, which is a statewhere the communication terminal is not coupled to the management system50. Furthermore, the “online” has a state where communication with thecommunication terminal indicated by the communication ID is possible(“communication OK”) and a state where the communication terminalindicated by the communication ID is communicating (“communicating”).

(Cooperation Management Table)

FIG. 7C is a conceptual diagram illustrating the cooperation managementtable. In the cooperation management table, for the communication ID ofeach of the speech terminals 10, the communication ID of the IWB 20operated in cooperation with the speech terminal 10 is managed inassociation with the communication ID of the speech terminal 10.Meanwhile, in a case of operating other communication terminals such asa projector or a digital signage device in cooperation with the speechterminal 10 or the IWB 20, in the cooperation management table, acommunication ID of the other communication terminals may be managed inassociation with the communication ID of the speech terminal 10 and thecommunication ID of the IWB 20.

(Image Information Management Table)

FIG. 7D is a conceptual diagram illustrating the image informationmanagement table. The image information management table is created foreach session ID of a session between IWBs 20. That is, each time asession between IWBs 20 is established, data are appended to the imageinformation management table. In the image information management table,for each of divided sections having sheet numbers, numbers of images,image information, a communication ID of an IWB 20 which is atransmission source of the image information, and a time when the imageinformation is created are managed in association with each other. Theimage information includes stroke information indicating a stroke suchas a “line” or a “circle”, text information indicating a text,information “delete” indicating an image to be deleted or the like.These pieces of image information may include coordinate informationindicating a position where an image is output or deleted, informationindicating a size, color or a font of an image or the like. Moreover,the image information may include not only the above-described imageinformation of the image to be added or the image information of theimage to be deleted, but also image information of an image to becorrected. In the present embodiment, text is an example of an image,and includes a character, a symbol and the like. The above-describedpieces of image information are stored in a field of image informationin the image information management table in an order of image numbersuntil the service ends (EOS: End of Service). Moreover, according to thepresent embodiment, the IWB 20 can output different images on respectivework spaces which can be switched by a tab displayed on the displaydevice 220. The above-described sheet numbers are numbers foridentifying the work spaces. Meanwhile, the “sheet” may be replaced byan arbitrary term indicating a region where an image is drawn, such as aworksheet, a space or a workspace.

(Respective Functional Configurations of Management System)

Next, functional configuration of the management system 50 will bedescribed in detail. Note that, in the following description offunctional configuration of the management system 50, among elementsillustrated in FIG. 5, relationships with main elements for realizingthe functional configuration of the management system 50 will also bedescribed.

The transmission/reception unit 51 is executed by a command from the CPU501 and by the network I/F 509, and performs transmission/reception ofvarious types of data (or information) to/from the respectivecommunication terminals, an apparatus or a system via the communicationnetwork 2.

The authentication unit 52 is operated by a command from the CPU 501,and performs authentication of a communication terminal by searching theauthentication management table (See FIG. 7A) with a communication IDand a password received via the transmission/reception unit 51 as searchkeys and determining whether the same pair of a communication ID and apassword is managed in the authentication management table.

The management unit 53 is operated by a command from the CPU 501. Themanagement unit 53 stores and manages, in the terminal management table(see FIG. 7B), for each communication ID and terminal name of the speechterminal 10 and the IWB 20, an operation state of the speech terminal 10or the IWB 20 in association with one another.

The creation unit 54 is operated by a command from the CPU 501, andcreates a document displayable on a browser. The document may be, forexample, described in the HyperText Markup Language (HTML).

The cooperation management unit 57 is operated by a command from the CPU501, and causes operations between communication terminals to cooperate.

The session control unit 58 is operated by a command from the CPU 501,and performs a control for a session of sending content data betweencommunication terminals. Meanwhile, here a session between speechterminals 10 will be denoted as a session sed1, and a session betweenIWBs 20 will be denoted as a session sed2. Moreover, the above-describedcontrol includes a control for establishing a session, a control forcausing a speech terminal 10 to participate the established session, acontrol for disconnecting the session or the like.

The storage/readout unit 59 is operated by a command from the CPU 501and the HDD 505, or operated by a command from the CPU 501. Thestorage/readout unit 59 performs processing to store various types ofdata in the storage unit 5000 or extract various types of data stored inthe storage unit 5000.

Process or Operation of Embodiment

Next, a process or an operation of the speech terminal 10, the IWB 20,and the management system 50 configuring the communication system 1according to the present embodiment will be described. Moreover, FIG. 8is a sequence diagram illustrating a process until a session between thespeech terminal 10 or the IWB 20 and the management system 50 isestablished.

As shown in FIG. 8, the speech terminal 10 performs a login request tothe management system 50 by using the transmission/reception unit 11(step S1). The login request includes a communication ID for identifyingthe speech terminal 10 of the login request source and a password.Accordingly, the transmission/reception unit 51 of the management system50 receives the login request with the communication ID and thepassword.

Next, the authentication unit 52 performs authentication of the speechterminal 10 of the login request source by determining whether the samepair of the communication ID and the password received by thetransmission/reception unit 51 is managed in the authenticationmanagement table (see FIG. 7A) (step S2). Then, in a case where it isdetermined to be a valid speech terminal by the authentication, themanagement unit 53 manages an operation state of “ONLINE” for acorresponding communication ID in the terminal management table (seeFIG. 7B) (step S3).

Next, the transmission/reception unit 51 sends an authentication resultto the speech terminal 10 of the login request source (step S4).Accordingly, the transmission/reception unit 11 receives theauthentication result. Then, in the case where it is determined to be avalid speech terminal in above-described step S2, a session “sei” isestablished between the speech terminal 10 of the login request sourceand the management system 50 (step S5). Meanwhile, in order todistinguish from each of the session “sed1” between speech terminals 10and the session “sed2” between IWBs, a session between a speech terminal10 or an IWB 20 and the management system 50 will be denoted as “sei”.

In the same ways as above, as shown in FIG. 8, the IWB 20 performs alogin request to the management system 50 by using thetransmission/reception unit 21 (step S21). The login request includes acommunication ID for identifying the IWB 20 of the login request sourceand a password. Accordingly, the transmission/reception unit 51 of themanagement system 50 receives the login request with the communicationID and the password.

Next, the authentication unit 52 performs authentication of the IWB 20of the login request source by determining whether the same pair of thecommunication ID and the password received by the transmission/receptionunit 51 is managed in the authentication management table (see FIG. 7A)(step S22). Then, in a case where it is determined to be a valid IWB bythe authentication, the management unit 53 manages an operation state of“ONLINE (communication ok)” for a corresponding communication ID in theterminal management table (see FIG. 7B) (step S23).

Next, the transmission/reception unit 51 sends an authentication resultto the IWB 20 of the login request source (step S24). Accordingly, thetransmission/reception unit 21 receives the authentication result. Then,in the case where it is determined to be a valid IWB in above-describedstep S22, a session “sei” is established between the IWB 20 of the loginrequest source and the management system 50 (step S25).

Next, with reference to FIG. 9, a process for establishing a session forsending content data between speech terminals 10 or between IWBs 20 willbe described. Meanwhile, FIG. 9 is a sequence diagram illustrating aprocess of establishing a session between the speech terminals 10 orbetween the IWBs 20. The session includes a session “sed1” for sendingsound data and image data between the speech terminals 10 and a session“sed2” for sending image information between the IWBs 20.

As shown in FIG. 9, the speech terminal 10, in response to an operationby a user for the operation button 108, by using thetransmission/reception unit 11, sends a communication start request tothe management system 50 (step S81). The communication start requestincludes a communication ID of the speech terminal 10 of a communicationstart request source and a communication ID of a destination speechterminal 10. In the following description, the communication startrequest source is assumed to be a speech terminal 10 a, and thedestination is assumed to be speech terminals (10 b, 10 c).

The transmission/reception unit 51 of the management system 50 receivesthe communication start request. Then, the management unit 53 of themanagement system 50 manages an operation state of “ONLINE(communicating)” for the communication ID of the speech terminal 10 a ofthe communication start request source in the terminal management table(see FIG. 7B) (step S82).

Next, the transmission/reception unit 51 of the management system 50sends a communication start request to the destination speech terminals(10 b, 10 c) (step S83). The communication start request includes thecommunication ID of the speech terminal 10 a of the communication startrequest source and the communication ID of the destination speechterminal (10 b or 10 c). Accordingly, the destination speech terminals(10 b, 10 c) receive the communication start request.

Contrary to this, the speech terminals (10 b, 10 c), in response to auser's operation for the operation button 108, by using thetransmission/reception unit 11, send information indicating responsepropriety to the management system 50 (step S84). The informationindicating response propriety shows that a response is performed in acase where a user's input for allowing speech is received on the side ofthe destination speech terminals (10 b, 10 c), and that a response isnot performed in a case where a user's input for rejecting speech isreceived on the side of the destination speech terminals (10 b, 10 c).In the following, the description continues in the case where the speechterminals (10 b, 10 c) send information showing that the response isperformed to the management system 50.

Accordingly, the transmission/reception unit 51 of the management system50 receives the information showing that the response is performed.Next, the management unit 53 of the management system 50 manages anoperation state of “ONLINE (communicating)” for the communication IDs ofthe destination speech terminals (10 b, 10 c) in the terminal managementtable (see FIG. 73) (step S85).

Next, the transmission/reception unit 51 of the management system 50sends to the speech terminal 10 a of the start request source theinformation showing that the response is performed which is sent fromthe destination speech terminals (10 b, 10 c) in above-described stepS84 (step S86). Accordingly, the speech terminal 10 a receives theinformation showing that the response is performed by using thetransmission/reception unit 11.

Next, the session control unit 58 of the management system 50 controlsestablishing the session “sed1” for sending image data and sound datavia the communication network 2 among the speech terminals (10 a, 10 b,10 c). A method for establishing the session “sed1” is not limited, butincludes, for example, a method for sending connection information forcoupling to a relay apparatus to the speech terminals (10 a, 10 b, 10 c)by the transmission/reception unit 51 based on control by the sessioncontrol unit 58, in a case where the relay apparatus for relaying imagedata and sound data is arranged on the communication network 2.Moreover, the transmission/reception unit 51 may send to the relayapparatus a request for starting relaying image data and sound dataamong the speech terminals (10 a, 10 b, 10 c) based on the control bythe session control unit 58. Moreover, as the method for establishingthe session “sed1”, a known method, such as the method described in FIG.25 of Japanese Unexamined Patent Application Publication No. 2012-50063may be employed.

Based on the above-described control method, the session “sed1” isestablished (step S88). Accordingly, the speech terminals (10 a, 10 b,10 c) become able to send/receive image data and sound data to/from thespeech terminals (10 c, 10 b, 10 a) which is a communications partner.

Next, the cooperation management unit 57 searches the cooperationmanagement table (see FIG. 7C) with the communication ID “01 a” of thespeech terminal 10 a of the communication start request source and thecommunication IDs “01 b, 01 c” of the destination speech terminals (10b, 10 c) as search keys, respectively, and reads out communication IDs“02 a, 02 b, 02 c” of corresponding IWBs 20 (cooperation terminals)(step S91).

Next, the management unit 53 associates an operation state of “ONLINE(communicating)” with the communication IDs “02 a, 02 b, 02 c” read outin step S91 and manages the communication IDs in the terminal managementtable (see FIG. 7B) (step S92).

Next, the session management unit 58 generates a session ID for thesession “sed2” for sending image information among the IWBs (20 a, 20 b,20 c) (step S93). The transmission/reception unit 51 of the managementsystem 50 sends the session ID generated in step S93 to the IWBs (20 a,20 b, 20 c) (steps S94-1, 2, 3).

Moreover, the session management unit 58 of the management system 50controls establishing the session “sed2” for sending image informationamong the IWBs (20 a, 20 b, 20 c) via the communication network 2 (stepS95). A method for establishing the session “sed2” is not limited, butmay include, for example, a method for sending destination informationof a communication partner (IWBs (20 b, 20 c)) to the IWB 29 a by thetransmission/reception unit 51 based on the control by the sessioncontrol unit 58, and thereby causing the IWB 20 to perform a callrequest to the IWBs (20 b, 20 c).

Based on the above-described control method, the session “sed2” isestablished (step S96). Accordingly, the IWBs (20 a, 20 b, 20 c)send/receive image information to/from the IWBs (20 c, 20 b, 20 a) whichis a communication partner, thereby an image can be shared.

Next, with reference to FIGS. 10A to 10C, a process of sending imageinformation among the IWBs 20 in the established session “sed” will bedescribed. Each of FIGS. 10A to 10C is a sequence diagram illustrating aprocess of sending image information among the IWBs 20.

First, with reference to FIG. 10A, a process of sending imageinformation by the IWB 20 a will be described. In a case where a user ofthe IWB 20 a brings a nib or another end of the input device 300 intocontact with the touch panel 224, the input device 300 sends a contactdetection signal. In a case where the signal reception device 225receives the contact detection signal, the touch panel 224 as theoperation input reception unit 22 receives an operation input by theinput device 300 (step S101).

Next, the display control unit 23 outputs image information depending onthe above-described operation based on a kind of the contact detectionsignal (writing detection signal or erasing detection signal) andcoordinate information detected by the touch panel 224. Accordingly, thedisplay control unit 23 causes the display device 220 to output an imagebased on the image information overlaying on the image output by theprevious process (step S102).

On the other hand, the transmission/reception unit 21 sends theabove-described image information, a sheet number of a sheet on whichthe image is drawn or the like, time at which the image information isgenerated, the communication ID of the own terminal (IWB 20 a) and thesession ID of the session “sed2” among the IWBs (20 a, 20 b, 20 c) tothe IWBs (20 b, 20 c) which are communications partners in the session“sed2” (steps S103-1, S103-2).

Furthermore, the transmission/reception unit 21 sends the imageinformation, the sheet number of the sheet on which the image is drawnor the like, time at which the image information is generated, thecommunication ID of the own terminal (IWB 20 a) and the session ID ofthe session “sed2” among the IWBs (20 a, 20 b, 20 c), which are the sameas those sent to the IWBs (20 b, 20 c), to the management system 5 whichis a communications partner in the session “sei” (step S104).

In a case where each of the transmission/reception unit 21 of therespective IWBs (20 b, 20 c) receives the image information set from theIWB 20 a, each display control unit 23 performs control of outputting animage based on the image information overlaying on the image output bythe previous process (steps S105-1, S105-2). Accordingly, each of theIWBs (20 b, 20 c) can output the same image as the image output on theIWB 20 a on the corresponding display device 220.

In a case where the transmission/reception unit 51 of the managementsystem 50 receives information from the IWB 20 a, the storage/readoutunit 59 additionally stores the image information, the communication IDand the time sent from the IWB 20 a in association with one another in asection of the sheet number sent from the IWB 20 a in the imageinformation management table (see FIG. 7D) prepared for the session“sed2” among the IWBs (201, 20 b, 20 c).

FIGS. 10B and 10C illustrate processes of sending image informationamong the IWBs 20, wherein the IWB (20 b or 20 c) is a transmissionsource of the image information. Since these processes (steps S111 toS116 or steps S121 to S125) are the same as those illustrated in FIG.10A (steps S101 to S106) except that roles of the respective IWBs 20 arechanged, detailed description will be omitted.

In this way, the display control unit 23 of each of the IWBs 20 performsa process of overlaying and outputting an image based on the imageinformation each time image information is generated at a timing ofreceiving a writing detection signal at the own terminal (IWB 20) oreach time image information (“Line”, “Circle” or “Text”) is sent fromeach of the IWBs 20 which are communications partners. Moreover, thedisplay control unit 23 performs a process of removing an imagecorresponding to image information “Delete” among the superimposedoutput images each time image information is generated at a timing ofreceiving an erasing detection signal at the own terminal (IWB 20) oreach time image information “Delete”, indicating erasure of images, issent from any of the IWBs 20 which are communications partners.

That is, in the process of communication by the session “sed2”, a partof the image shared among the IWBs (20 a, 20 b, 20 c) is added orremoved.

Moreover, each time any of the IWBs 20 sends image information in thesession “sed2”, the image information, communication ID, time and thelike are added to the image information management table of themanagement system 50. Accordingly, in the management system 50, it ispossible to manage each piece of image information based on operationsin each of the IWBs 20.

Next, with reference to FIG. 11, a process of reproducing an imageshared among the IWBs (20 a, 20 b, 20 c) after the IWB 20 a leaves thesession “sed2” will be described. FIG. 11 is a sequence diagramillustrating a process of reproducing the image. In the following, theprocess of reproducing the image at the IWB 20 a will be described, butthe terminal that reproduces the image is not limited to the IWB 20 a.For example, the image may be reproduced at another IWB 20, or anothercommunication terminal such as a PC (Personal Computer) which realizesat least a part of the function of the transmission/reception unit 21,the display control unit 23 or the like according to a concertedoperation by application and hardware. In this case, the IWB 20 a in thefollowing description may be replaced by the other IWB 20 or the othercommunication terminal.

The management system 50 according to the present embodiment has a Webserver function. The IWB 20 can reproduce an image by using an imagereproduction service provided by a Web server function of the managementsystem 50.

First, the transmission/reception unit 21 of the IWB 20 a, in responseto an operation input by a user, accesses the image reproduction serviceof the management system 50 (step S201). In response to the access, thetransmission/reception unit 51 of the management system 50 sends to theIWB 20 a an HTML file for a login screen to the image reproductionservice (step S202). FIG. 13A is a diagram illustrating an example ofthe login screen.

The transmission/reception unit 21 of the IWB 20 a, in response to anoperation by the user, sends to the management system 50 a communicationID and a password input to the login screen (step S203).

The authentication unit 52 of the management system 50 performsauthentication of a login request source by determining whether the samepair as a pair of the communication ID and the password sent from theIWB 20 a is managed in the authentication management table (see FIG. 7A)(step S204).

In a case where it is determined to be a valid terminal by theabove-described authentication, the creation unit 54 searches the imageinformation management DB 5004 with the communication ID of the IWB 20 awhich is login request source as a search key, and extracts an imageinformation management table (see FIG. 7D) including the communicationID. Furthermore, the creation unit 54, based on information recorded inthe respective extracted image information management tables, identifiesparticipation date and time, participation time, a number of locations(number of participating terminals) regarding each of the sessions“sed2” in which the IWB 20 a participates. Then, the creation unit 54creates an HTML file of a conference history screen on which therespective identified participation date and time, the respectiveparticipation time, the respective number of locations and a button forreceiving a request for reproducing an image generated at each of thesessions “sed2” (step S205). FIG. 13B is a diagram illustrating anexample of a conference history screen.

The transmission/reception unit of the management system 50 sends theHTML file of the conference history screen to the IWB 20 a (step S206).

In a case of receiving a selection of a button (any of whiteboardinformation reference buttons in the conference history screen in FIG.13B) for receiving a request for reproducing an image generated at anyof the sessions “sed2” by the operation input reception unit 22, thetransmission/reception unit 21 sends a request for reproducing an imagegenerated at the selected session “sed2” to the management system 50(step S207).

In a case where a request for whiteboard information is received by thetransmission/reception unit 51 of the management system 50, the creationunit 54 reads out image information, communication ID and time relatedto all images for each sheet number from the image informationmanagement table (see FIG. 7D) corresponding to the selected session“sed2” (step S208). Moreover, as a part of the process in step S208, thecreation unit 54 creates an HTML file of a whiteboard sharing screen.

Subsequently, the transmission/reception unit 51 of the managementsystem 50 sends the HTML file of the whiteboard sharing screen to theIWB 20 a (step S209). As a part of the process in step S209, thetransmission/reception unit 51 sends to the IWB 20 a the imageinformation, the communication ID and the time related to all images foreach sheet number from the image information management table in stepS208 in association with one another.

In a case where the transmission/reception unit 21 of the IWB 20 areceives the HTML file of the whiteboard sharing screen and respectivepieces of information read from the image information management table,the display control unit 23 controls an output of the whiteboard sharingscreen (step S210). With reference to FIG. 12, a process of controllingthe output of the whiteboard sharing screen will be described. FIG. 12is a flowchart illustrating the process of controlling the output of thewhiteboard sharing screen.

First, the display control unit 23 outputs the whiteboard sharing screensent from the management system 50 to the display device 220 (stepS210-1). Next, the display control unit 23 outputs an image reflectingall pieces of image information related to a default sheet number (e.g.Sheet No. 1) among the pieces of image information sent from themanagement system 50 to the whiteboard sharing screen superimposedly.Meanwhile, the default sheet is not especially limited, but may be basedon a setting by a user or may be a sheet displayed finally in thesession “sed2”. FIG. 14 is a diagram illustrating an example of thedisplay image of the display device in step S210-2. According to theabove-described process, an image of sheet No. 1 at the close of theconference is displayed on the whiteboard sharing screen.

In a case where the operation input reception unit 22 receives aselection of a radio button indicating displaying a location name in thewhiteboard sharing screen (step S210-3: YES), the display control unit23 controls an output of a communication ID in the whiteboard sharingscreen (step S210-4). Specifically, the display control unit 23displays, adjacent to each image displayed in the whiteboard sharingscreen, the communication ID of the IWB 20, which sends the imageinformation related to the image. Meanwhile, since the management system50 sends to the IWB 20 a each piece of image information and acommunication ID of an IWB 20, which is a transmission source of theimage information in association with each other, the display controlunit 23 of the IWB 20 a can display, adjacent to each image, thecommunication ID of the IWB 20 which sends the image information relatedto the image, as described above. FIG. 15 is a diagram illustrating anexample of the display image of the display device in step S210-4. Bythe image, a user of the IWB 20 a can see at which IWB 20 each image iscreated.

In a case where the operation input reception unit 22 receives aselection of an operation button displayed in the whiteboard sharingscreen (step S210-5: YES), the display control unit 23 updates an imageto be output (step S210-6). For example, in the whiteboard sharingscreen, shown in FIG. 15, in a case of receiving a selection of abackward reproduction button 220 a among the operation buttons, thedisplay control unit 23 outputs images superimposed without reflectingimage information created finally among pieces of image informationrelated to the image displayed in the whiteboard sharing screen.Meanwhile, since the management system 50 sends to the IWB 20 a eachpiece of image information and a creation time of the image informationin association with each other, the display control unit 23 of the IWB20 a can identify the image information created finally among thetransmitted pieces of image information.

For example, in a case where the image information created finally isimage information “delete” related to image erasing, the display controlunit 23 outputs images superimposed without reflecting the image erasingbased on the image information “delete” created finally. That is, it ispossible to reproduce the image erased finally. FIG. 16 is a diagramillustrating an example of the display image of the display device instep S210-6.

The above-described process is repeatedly executed until the operationinput reception unit 22 receives a stop instruction for output of thewhiteboard sharing screen (step S210-7: YES). For example, in thewhiteboard sharing screen in FIG. 16, in a case where the reproductionbutton 220 b is selected among the operation buttons, the display imagein FIG. 16 returns to the display image in FIG. 15. Moreover, in thewhiteboard sharing screen in FIG. 15, in a case where a radio buttonindicating not displaying a location name is selected, the display imagein FIG. 15 returns to the display image in FIG. 14.

Variation of the Embodiment

According to the communication system 1 of the present embodiment, it ispossible to switch whether to leave the whiteboard sharing screen ornot. In this case, the display control unit 23 of the IWB 20 displays onthe display device 220 a screen for receiving an input whether to leavethe whiteboard sharing screen or not at an arbitrary timing until thesession “sed2” is established. FIG. 17 is a diagram illustrating anexample of the display image of the display device.

The transmission/reception unit 21 of the IWB 20 sends to the managementsystem 50 information received by the operation input reception unit 22at an arbitrary timing until the session “sed2” is establishedindicating whether to leave the whiteboard sharing screen or not. In acase of selecting not to leave the whiteboard sharing screen, even ifimage information is sent to the management system 50 from the IWB 20,the storage/readout unit 59 of the management system 50 does not storethe image information in the storage unit 5000. Or, the storage/readoutunit 59 of the management system 50 may store the image information inthe storage unit 5000. But, after the IWB 20 leaves the session “sed2”,the image information stored in the storage unit 5000 is erased.

Main Effect of the Embodiment

Next, main effect of the above-described embodiment will be described.

In the session “sed2” among the plurality of IWBs 20 (example ofcommunication terminals), image information “Line, Circle, Text” relatedto an image output at the plurality of IWBs 20, image information“delete” for stopping output at the plurality of IWBs 20 or the like istransmitted. The storage/readout unit 59 of the management system 50 (anexample of an image management system) adds image information sent fromthe IWB 20 to the management system 50 to an image informationmanagement table of an image information management DB 5004 (an exampleof image management means), each time the image information istransmitted in the session “sed2”. Accordingly, in the image informationmanagement DB 5004, each piece of image information transmitted in thesession “sed2” is managed. The transmission/reception unit 51 of themanagement system 50 (an example of transmission means) sends each pieceof image information managed in the image information management DB 5004to an IWB 20 which can output an image based on the image information.At this time, since the image information sent to the IWB 20 includes atleast each piece of image information “Line, Circle, Text” transmittedin the session “sed2”, even in a case where the image shared in theprocess of communication among the IWBs 20 is erased, the erased imagecan be reproduced in the IWB 20.

Moreover, since the image information to be sent to the IWB 20 furtherincludes each piece of image information “Delete” transmitted in thesession “sed2”, a process of forming an image end erasing in the session“sed2” can be reproduce in the IWB 20.

The image information management table of the image informationmanagement DB 5004 manages the image information and informationindicating creation time of an image in association with each other. Thetransmission/reception unit 51 sends to the IWB 20 each piece of imageinformation managed in the image information management means and theinformation indicating the creation time of the image.

Accordingly, in the IWB 20, it is possible to reproduce images in anorder of creation based on the information indicating the creation time.

The image information management DB 5004 manages the image informationand a communication ID (an example of identification information) of anIWB 20 which is a transmission source of the image information inassociation with each other. The transmission/reception unit 51 sends tothe IWB 20 each piece of image information managed in the imageinformation management DB 5004 and the communication ID of the IWB 20which is a transmission source of the image information.

Accordingly, on a side of the IWB 20, it is possible to perceive atwhich IWB 20 a reproduced image is formed.

The transmission/reception unit 21 (an example of a reception means) ofthe IWB 20 receives each piece of image information sent from themanagement system 50. The display control unit 23 (an example of outputcontrol means) of the IWB 20 controls an output of an image based on theimage information received by the transmission/reception unit 21.

Accordingly, in the IWB 20, it is possible to reproduce the image basedon each piece of image information.

The transmission/reception unit 21 of the IWB 20 receives each piece ofimage information sent from the management system 50 and informationindicating creation time of the image information. The display controlunit 23 of the IWB 20 controls an output of an image based on the imageinformation received by the transmission/reception unit 21 and theinformation indicating the creation time.

Accordingly, in the IWB 20, it is possible to reproduce images in anorder of creation.

An image output from each communication terminal is updated not only byappending an image formed in the process of communication betweencommunication terminals but also by deleting a part of an image. In acase of using the communication system of the related art, there is aproblem that even though a finally formed image can be reproduced on thecommunication terminal, the image formed in the process of communicationbetween the communication terminals cannot be reproduced.

As described above, according to the present embodiment, an effect thatan image formed in the process of communication can be reproduced on acommunication terminal is provided.

Supplement to Embodiment

In the above-described embodiment, the case, in which a start ofcommunication among three speech terminals 10 and a start ofcommunication among three IWBs 20 are cooperated with each other, isexplained. However, the present invention is not limited to the aboveembodiment. For example, a start of communication among arbitrarynumbers (two or more) of speech terminals 10 and a start ofcommunication among arbitrary numbers (two or more) of IWBs 20 may becooperated with each other.

Respective programs for the speech terminal 10, the IWB 20 and themanagement system 50 may be stored in a computer readable recordingmedium (recording medium 106 or the like) as a file in a installableform or in an executable form, and distributed. Moreover, as otherexamples of the recording medium, a CD-R (Compact Disc Recordable), aDVD (Digital Versatile Disk), a Blu-ray disk or the like may beemployed. Moreover, the above-described recording medium or the HD 504storing these programs may be provided as a program product inbound orabroad.

Moreover, the speech terminal 10, the IWB 20 and the management system50 in the embodiment may be configured with a single apparatus or may beconfigured with a plurality of apparatuses to which divided respectiveparts (functions or means) are assigned arbitrarily.

Moreover, in the above-described embodiment, as an example of an imagesharing apparatus, the IWB 20 is explained. The present invention is notlimited to this. For example, the IWB 20 may be an electronicblackboard, a personal computer (PC) having an image sharing function orthe like.

Furthermore, in the above-described embodiment, the video conference bythe image forming apparatus (intermediate concept) such as the IWB 20(lower concept) is explained. The present invention is not limited tothis. The present invention includes an application of theabove-described embodiment in a field of communication as a widerconcept including the video conference. For example, the above-describedembodiment can be applied in a case of sending image information relatedto an image output at a plurality of communication terminals among thecommunication terminals in a projector system, a digital signage device,a text sharing system, a car navigation system, a communication systemof gaming machines or the like.

Further, the present invention is not limited to these embodiments, butvarious variations and modifications may be made without departing fromthe scope of the present invention.

What is claimed is:
 1. An image management system comprising: processingcircuitry configured to manage at least a piece of image informationamong pieces of information transmitted in a first session between aplurality of communication terminals, the piece of image informationbeing related to an image output at each of the communication terminals,and the image output at each of the communication terminals including aplurality of pieces of image information corresponding to separateimages that are overlaid upon each other based on different and separateactions performed at respective ones of the communication terminals, theat least a piece of image information corresponding to one of theseparate images; and send the piece of image information managed by theprocessing circuitry to a first communication terminal configured tooutput an updated image based on the piece of image information, whereineach of the communication terminals is an interactive whiteboard and atleast two of the communication terminals are co-located with respectivespeech terminals that are configured to communicate at least image dataand sound data with each other over a second session of avideoconference that is different than the first session between theplurality of communication terminals, and the processing circuitry isconfigured to establish the first session between the plurality ofcommunication terminals in response to establishment of the secondsession of the videoconference, wherein the processing circuitry isconfigured to manage the piece of image information, a piece ofgeneration time information indicating generation time of the piece ofimage information, and a piece of identification information foridentifying a communication terminal that is a transmission source ofthe piece of image information, in association with each other, and theprocessing circuitry is configured to send the piece of imageinformation managed by the processing circuitry the generation timeinformation indicating the generation time of the piece of imageinformation, and the piece of identification information for identifyingthe communication terminal that is the transmission source of the pieceof image information, to the first communication terminal.
 2. Acommunication terminal comprising: processing circuitry configured toreceive, from the image management system according to claim 1, thepiece of image information; and control an output of an updated imagebased on the received piece of image information.
 3. A communicationsystem comprising: a plurality of communication terminals including afirst communication terminal; and the image management system accordingto claim
 1. 4. The image management system according to claim 1, whereinthe at least a piece of image information includes stroke informationindicating a predetermined type of stroke input at a respectiveinteractive whiteboard.
 5. The image management system according toclaim 1, wherein the at least a piece of image information includescoordinate information indicating a position at a respective interactivewhiteboard where an input was received.
 6. The image management systemaccording to claim 1, wherein each interactive whiteboard is configuredto output different images on different switchable workspaces, and theat least a piece of image information includes information indicating aparticular workspace of a respective interactive whiteboard.
 7. Theimage management system according to claim 1, wherein the processingcircuitry establishes the first session between the plurality ofcommunication terminals based at least in part on checking apredetermined association of each of the plurality of communicationterminals and the respective speech terminals.
 8. The image managementsystem according to claim 1, wherein the processing circuitryestablishes the first session between the plurality of communicationterminals by sending, to a first one of the plurality of communicationterminals, destination information of at least another one of theplurality of communication terminals and causing the first one of theplurality of communication terminals to make a call request to the atleast another one of the plurality of communication terminals.
 9. Acommunication terminal comprising: processing circuitry configured toreceive, from the image management system according to claim 1, thepiece of image information and the piece of generation time informationindicating the generation time of the piece of image information; andcontrol an output of an updated image based on the piece of imageinformation and the piece of generation time information indicating thereceived generation time of the image information.
 10. The imagemanagement system according to claim 9, wherein the processing circuitryestablishes the first session between the plurality of communicationterminals based further on checking that the plurality of communicationterminals are online.
 11. An image management method implemented by animage management system comprising: adding, to pieces of imageinformation managed by processing circuitry in an image managementsystem, at least a piece of image information among pieces ofinformation transmitted in a first session between a plurality ofcommunication terminals, the piece of image information being related toan image output at each of the communication terminals, and the imageoutput at each of the communication terminals including a plurality ofpieces of image information corresponding to separate images that areoverlaid upon each other based on different and separate actionsperformed at respective ones of the communication terminals, the atleast a piece of image information corresponding to one of the separateimages; and sending the piece of image information managed by theprocessing circuitry to a first communication terminal configured toupdate the outputted image based on the piece of image information,wherein each of the communication terminals is an interactive whiteboardand at least two of the communication terminals are co-located withrespective speech terminals that are configured to communicate at leastimage data and sound data with each other over a second session of avideoconference that is different than the first session between theplurality of communication terminals, and the method includesestablishing the first session between the plurality of communicationterminals in response to establishment of the second session of thevideoconference and the method further includes managing the piece ofimage information, a piece of generation time information indicatinggeneration time of the piece of image information, and a piece ofidentification information for identifying a communication terminal thatis a transmission source of the piece of image information, inassociation with each other, and sending the managed piece of imageinformation, the generation time information indicating the generationtime of the piece of image information, and the piece of identificationinformation for identifying the communication terminal that is thetransmission source of the piece of image information, to the firstcommunication terminal.
 12. The image management method according toclaim 11 further comprising: receiving at the first communicationterminal the piece of image information; and controlling an output of anupdated image based on the received piece of image information.
 13. Anon-transitory computer-readable storage medium storing a program forcausing a computer of an image management system to execute a process ofmanaging an image, the process comprising: adding, to pieces of imageinformation managed by processing circuitry in an image managementsystem, at least a piece of image information among pieces ofinformation transmitted in a first session between a plurality ofcommunication terminals, the piece of image information being related toan image output at each of the communication terminals, and the imageoutput at each of the communication terminals including a plurality ofpieces of image information corresponding to separate images that areoverlaid upon each other based on different and separate actionsperformed at respective ones of the communication terminals, the atleast a piece of image information corresponding to one of the separateimages; and sending the piece of image information managed by theprocessing circuitry to a first communication terminal configured toupdate the outputted image based on the piece of image information,wherein each of the communication terminals is an interactive whiteboardand at least two of the communication terminals are co-located withrespective speech terminals that are configured to communicate at leastimage data and sound data with each other over a second session of avideoconference that is different than the first session between theplurality of communication terminals, and the process includesestablishing the first session between the plurality of communicationterminals in response to establishment of the second session of thevideoconference, and the process further includes managing the piece ofimage information, a piece of generation time information indicatinggeneration time of the piece of image information, and a piece ofidentification information for identifying a communication terminal thatis a transmission source of the piece of image information, inassociation with each other, and sending the managed piece of imageinformation, the generation time information indicating the generationtime of the piece of image information, and the piece of identificationinformation for identifying the communication terminal that is thetransmission source of the piece of image information, to the firstcommunication terminal.